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signal from far fewer measurements tha^vlts dimension. The compressive sampling theory 

. 

assures almost an exact recovery of a sparse signal if the signal is sensed randomly where the 
number of the measurements taken is proportionalCto the sparsity level and a log factor of the 
signal dimension. Encouraged by this emerging s tec*hnique, we study the application of 
compressive sampling to speech signals. ^ 

The speech signal is very dense in its natural domam^owever speech residuals obtained 
from linear prediction analysis of speech are nearly sparse. We^a|5ply compressive sampling to 
speech signals, not directly but on the speech residuals obtaine^^y conventional and robust 



linear prediction techniques. We use a random measurement matrix\f@>^&cquire the data then use 
£-1 minimization algorithms to recover the data. The recovered reSiHh)als are then used to 

ex. 

synthesize the speech signal. It was found that the compressive sampling process successfully 
recovers speech recorded both in clean and noisy environments. We further sho^lhat the quality 
of the speech resulting from the compressed sampling process can be considerably^nhanced by 
spectrally shaping the error spectrum. The recovered speech quality is said to be of high quality 
with SNR up to 15 dB at a compression factor of 0.4. 
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1.0 INTRODUCTION 

\ 

Speech has always been the most popular tool of communication; speech processing has been an 
interesting field of study that attracted a lot of attention during the last 40 years. New 
technologies have been studied to reducOhe speech transmission rates while maintaining a good 
quality of the transmitted speech. Compressive sampling is a new developing technique of data 
acquisition that offers a promise of recoverirTg^fche data from a fewer number of measurements 
than the dimension of the signal. The goal of^j^i work is to study and apply compressive 
sampling techniques on speech signals. We apply co'rnj^essive sampling on speech residuals then 
synthesize the speech from the recovered residuals, behavior of the recovered signals is 
thoroughly investigated for male and female speech signals^recorded in both clean and noisy 
settings. • 

This document is divided into two parts. Part I is a backgi^rdnd and literature review and 

o 

is organized as follows. Chapter 2 provides an introduction to^^eech signals where the 
production mechanism and the classification of speech signals are brie|w}explained. In Chapter 

o 

3, some speech coding techniques are described. Linear prediction is explained in detail in 
Section 3.1. Since we apply compressive sampling to the residual signal, ^is important to 
explain the linear prediction methods and the properties of the prediction filter and^j^ prediction 
error. Section 3.2 highlights the multi-pulse excited linear prediction coding. The multi-pulse 
excitation is presented to get familiar with the sparse nature of the excitation signal and to 
introduce a pulse search algorithm that is comparable to the orthogonal matching pursuit 
algorithm presented later in Chapter 4. Robust linear prediction is presented in Section 3.3 since 

1 



it results in a prediction filter that better fits the speech spectrum. Compressive sampling is 
introduced in Chapter 4. The compressive sampling problem is stated and explained in detail; 
and examples are provided ^£>ng with two possible solutions to the problem. 

Implementation and re^lt discussions are provided in Part II of this document. In 



Chapter 5, the compressive sampjing process is applied to speech residuals obtained from 
conventional and robust linear predi&iftn techniques and the recovery results are compared for 
the two cases. Chapter 6 addresses the/rspectral shaping of the compressive sensing noise. 
Spectral shaping as a concept is briefly intr^tuced and several shaping filters are used to search 
for the filter that best shapes the noise and resuNsin the best quality of speech. 



tsjn 
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The results of the implementation conclusions and future direction are summarized 
Chapter 7. Y*' 
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2.0 THE SPEECH SIGNAL 



Speech has always been the^most dominant and common way of communication. The 
information contained in the spoken^word is conveyed by the speech signal. In order to analyze 
speech transmission and processing^ve need to understand the basic structure of the speech 
signal and its production models. \S 

This chapter introduces the speech Signal in an attempt to answer the questions of how 
speech is produced and how it could be modeled; what its main characteristics are and how it 
may be classified. Section 2.1 answers the first quesfton, and Section 2.2 answers the last one. 

\ 

2.1 HUMAN GENERATION <($F SPEECH 

The speech waveform is a sound pressure wave originating irom controlled movements of 
anatomical structures making up the human speech production s ^ejri [1]. Figure 1 shows a 
model of vowel production. In vowel production, air is forced from tflJ^ngs by contraction of 
the muscles around the lung cavity. Air then flows past the vocal cords, w lQh^ are two masses of 
flesh, causing periodic vibration of the cords whose rate gives the pitch <of the sound; the 

o 

resulting periodic puffs of air act as an excitation input, or source, to the vocal 1@bt. The vocal 
tract, which is the cavity between the vocal cords and the lips, acts as a resonator that spectrally 
shapes the periodic input. 

A simple engineering model, referred to as the source/filter model, can thus be built 
based on this production mechanism. If we assume that the vocal tract is a linear time-invariant 



system with a periodic impulse-like input, then the pressure output at the lips is the convolution 
of the impulse-like train with the vocal tract impulse response, and therefore is itself periodic [2]. 
This is a simple model of a ^ady-state vowel. The speech utterance consists of a string of vowel 
and consonant phonemes whgse temporal and spectral characteristics change with time, 
corresponding to a changing excitartijbn source and vocal tract system [2]. 

"A 



Figure 1. 
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Speech production mechanism and model of a steady-state vowel. 

The acoustic waveform is modeled as the output of a linear time-invariant system with a 
periodic impulse-like input. In the frequency domain, the vocal tract system function 
spectrally shapes the harmonic input [2]. 

% 



2.2 CLASSIFICATION OF SPEECH SIGNALS: VOICED VS UNVOICED 



As described in Section 2.1, a sound source is generated by the vocal folds then spectrally shaped 
in the vocal tract to generate a sound. Sounds hence can be classified in many ways; either based 

4 



on the nature of the source (the air puffs) or the shape of the vocal tract (the position of the 
tongue and the degree of its constriction). Sounds can also be classified based on their time 



domain waveform or the tir^v varying spectral characteristics [2]. Therefore, we need a specific 
classification of sounds that cri^be used in modeling the speech for digital signal processing 



applications. ^ 

Speech sounds can be roughrV>p)lassified, based on the nature of the source, into voiced 
and unvoiced [3]. Voiced sounds are proofed when air is forced through the vocal cords so their 
vibration results in a sequence of quasi-pe^adic pulses that excites the vocal tract. Unvoiced 
sounds result when forcing air through the voca^fjjsact without vibrating the vocal cords [2]. 

Voiced and unvoiced sounds have diff^rit properties and hence are reproduced 
differently, as will be discussed in the next chapter. Yi^refore, it is important for some speech 
coders to classify the speech signal into voiced and unv^^ifced sounds. The main characteristics 
that are used to distinguish between voiced and unvoiced ^Sj)inds are: periodicity, energy, and 
zero crossing. 

o 

2.2.1. Periodic nature of the speech signal ^\S^ 

In the time domain, the voiced sound signal is clearly periodic with a funoamental frequency 
called the pitch. Pitch ranges from 50 to 250 Hz for men and from 120 to 500 H^for women [1]. 

a 

On the other hand, unvoiced sounds are not periodic and further have a random natwra 

Figure 2 shows an example for a voiced and an unvoiced utterance, [oh] and [sh] 
respectively, by a female speaker and an expanded view of a 40 ms frame of each utterance. The 
expanded frame view shows the periodic nature of the voiced sound and the random nature of the 
unvoiced sound. 



In the 40 ms slice of the voiced sound in Figure 2, the pattern repeats itself about nine 
times, where each repetition corresponds to one cycle of the vocal cords opening and closing. 
Thus the period of the patfgen is about 4.44 ms and the fundamental frequency is then about 



225.23 Hz. 
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Figure 2. 

Since voiced sounds are periodic and unvoiced sounds are not, measuringythe periodic 
similarity between samples in consecutive pitch cycles can give a reasonable indication of the 
voicing of the signal. The Pitch Similarity measurement (P s ) can be computed by [4] 
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Pc = 



[lZ=Zs(n)s(n-T)] 



(2-1) 



where T is the pitch period gfad N is the number of samples per frame. Pitch period estimation is 
presented in Sub-Section 3.1. < f^>fthe next chapter. 

P s values vary betweeR 0 and 1, indicating no similarity and 100% similarity 
respectively. Figure 3 shows a time -plot of the waveform of the word [psychology] against the 



p it eh W . The p,o, shows te th^ced pa rtS of ,he speech have h ig he r pitch similarity 

1 I 1 [ 1 1 1— 



than the unvoiced parts. 
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Figure 3. Speech waveform and the corresponding pitch similarity plot with a possifoj^ voicing 

threshold of 0.5 (shown by the dashed line) Q 
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2.2.2. Short time energy 



Generally, the amplitude o£unvoiced speech segments is much lower than the amplitude of 
voiced segments, (e.g. see Figure 2). The energy of the speech signal provides a representation 
that reflects these amplitude vari^ons. The short-time energy G of an iV-sample frame is 
defined as: 

^ N-l 

e ©Y 5 2 (n) (2.2) 

%. 

where s(n), n = 0, 1, ... , N — 1 is one speech ftame. 

Typically, voiced sounds have higher energy than-uftvoiced ones [3]. 

It can be seen in Figure 4 that the short time>energy of the voiced parts of the word 

o ^ 

[psychology] is higher than the energy for the unvoiced parts. 
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Figure 4. Speech waveform and the corresponding short time energy plot with a possible voicing 

threshold of 0.4 (shown by the dashed line) 
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2.2.3. Zero crossing rate 



In the context of discrete-tia^signals, a zero crossing is said to occur if successive samples have 
different algebraic signs. The Z^ro Crossing Rate (ZCR) is the number of times in a given time 



crosses zero. 



where 



interval/frame that the amplitude of^he speech signal 

ZCR = — ^j^i[s(n)] - sgn[s(n + 1)]| 

r , v, (\t s(n) > 0 
s^[5(n)] = |_£ s(n) < Q 



(2.3) 



(2.4) 
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Figure 5. Speech waveform and the corresponding zero crossing rate plot with a possible voicing 

threshold of 0.5 (shown by the dashed line) 
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Unvoiced speech has random characteristics causing it to oscillate much faster than 
voiced speech [3]. ZCR also depend on the signal pitch (for voiced sounds); e.g., ZCR for voiced 
female speech is higher thaf^ihat for voiced male speech [4], which can result in a bias voicing 
decision for voiced female speech.. Therefore a simple pitch weighting can be used to weight the 



decision threshold [4]. Figure 5 i^pve shows an example of the ZCR criterion for the word 

V 

[psychology] by a female speaker; the>ZCR is weighted by multiplying it by the pitch period of 
the frame to enhance the decision thresho'^ 

2.2.4. Spectrum tilt \y 

% 

Voiced speech has higher energy in low frequencies and unvoiced speech usually has higher 

energy in high frequencies resulting in opposite spectral tilrs^the spectral tilts can be represented 

by the first order normalized autocorrelation coefficient [4]. 

The Spectral tilt (S t ) can be calculated by 

£n-os(n)s(n- 1) 
S t = vn-1 2, ^ & (2 - 5) 

Figure 6 shows the classification of a speech segment using the spectral tilt criterion. 

% 
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Figure 6. Speech waveform and the corresponding sp 

of 0.5 (shown by the dashed line) 
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The above decision criteria along with other criteria [4] are used^to take the frame's voicing 
decision. Sometimes it is not absolutely clear if a frame is voicedfi^_unvoiced especially for 
transitional frames (frames during the transition from voiced to unvoice^^^mnds and vice versa) 
making it difficult to judge the frame as strictly voiced or strictly unv(}iced. The simplest 
decision making rule would be to use a majority vote [4], that is to use many(3fecision criteria 
then make a combined decision. Some frames are harder to classify than others, tjmvever, it is 
still important to classify the frames as accurately as possible in order to correctly reproduce a 
high quality speech as will be described in the next chapter. 
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3.0 SPEECH CODING 



Speech coding, or speech oppression, plays an important role in modern voice-enabled 
technologies like digital speech Communication, voice over Internet protocol and voice storage. 
Speech coding is the process where a-raw speech signal is digitally represented with as few bits 
as possible while preserving a reasonapfe level of quality for the reconstructed (synthesized) 

CO 

speech [1]. Speech coding systems attempt) to achieve a compromise between compression, 
quality and complexity. 

•0 

Traditionally, most speech coding systemsOare designed to support telecommunication 
applications with frequency limited between 300 and34Q0 Hz [1]. Since the sampling frequency 

c 

is at least twice the bandwidth of the signal, according tO-Nyquist theorem, a sampling frequency 
of 8 kHz is commonly used as a standard sampling frequency^ir speech signals. 

Speech coding techniques can be broadly divided ?n^ two classes, waveform and 
parametric coding methods [4]. Waveform coders attempt to p^o^uce a reconstructed signal 



whose waveform is as close as possible to the original speech wavefo^Ht^Parametric coders, also 
known as vocoders, try to extract the parameters of the model that is responsible for generating 
the speech signal. Waveform coders are able to produce high quality speet^n at high bit rates; 
vocoders however are able to generate intelligible, yet not so natural sounding(^peech at much 

C) 

lower bit rates. vO> 

This chapter is devoted studying vocoders that are based on a linear prediction model. 
The linear prediction problem is introduced in Section 3.1 and the autocorrelation solution to the 
problem is studied. Linear prediction vocoders are also presented. Those coders basically receive 
a raw sampled speech signal and analyze it in a frame by frame manner. The output parameters 

12 



of linear prediction coders are the voiced/unvoiced decision, the all-pole filter coefficients, the 
pitch period and the gain. These parameters are then quantized and sent over the transmission 



channel to be used at the reg&iver to generate a synthetic version of the input speech. Although 
the linear prediction model is ^gry basic and results in a low bit rate, below 2.5 kbits/sec, the 
resultant synthesized speech is not^f a high quality, does not sound natural and suffers annoying 
artifacts such as buzzes, cracks and topaJ noises because of the degradation due to errors in pitch 
estimation and voiced/unvoiced decisions^]. 

In order to improve the quality of tl^synthesized speech, a multi-pulse excitation model 
[5], described in Section 3.2, suggests quari^ng and sending the linear prediction filter 
coefficients along with a multi-pulse excitation seqs^nce. The coefficients and the excitations are 
then used at the receiver end to synthesize the speechVThis approach increases the quality of the 

V 

synthesized speech with bit rates below 16 kbits/sec. \S 

Section 3.3 introduces robust linear prediction wherd^ifferent methods of finding better 
linear prediction coefficients are presented. 

o 

3.1 LINEAR PREDICTION CODING xO 

Linear Prediction (LP) methods can be viewed as redundancy removal p^o^edures where 
repeated/predictable information in a signal is eliminated. Redundancy elimination results in 
signal compression since the number of bits required to represent the information is reduced [1]. 

Linear prediction is one of the most useful linear prediction based speech analysis 
models. It is widely used for encoding speech at low bit rates and yet provides very accurate 
estimates of the speech parameters [3]. LP based vocoders are designed to simulate the human 

13 



speech production mechanism [4], where the vocal tract is modeled by a linear prediction filter 
H(z) as shown in Figure 7. H(z) is excited by either a quasi-periodic pulse train with impulses 
located at pitch period internals for voiced speech production, or by random noise for unvoiced 
speech production. ^ 




) — ► 








1 



_^(n) 



% 

Figure 7. Discrete speech production model [£f 

The basic idea behind LP analysis is that a^>eech signal s(n) can be approximated by a 
linear combination of past samples of the signal and past and present samples of an 

unknown input u(n) such that: C> 

v v ® 

s(n) = — y a.k s (. n — k) + G y biu(n — I) , , £> 0 = 1 (3.1) 

fc = l i=o ^ 

O 

where a fc , 1 < k <p , b\ , 1 < I < q and the gain G are the para^rn^rs of the hypothesized 
system [6]. q 



In the frequency domain, equation (3.1) becomes: 



H(z) = ^ = C TTi&^ % (3 ' 2> 

oo 

S(z) = ^ s(n)z- n (3.3) 
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where S(z) is the z transform of s(n), t/(z) is the z transform of u(n), and H(z) is the same 
transfer function of the system in Figure 7. H(z) in equation (3.2) is a general pole-zero model 
which has two interesting sp^^al cases: 

• The all-zero, moving av^tage (MA), model: a k = 0 for 1 < k < p 

• The all-pole, autoregressivi^fAR), model: b x = 0 for 1 < I < q 
Autoregressive models are kndwh to well represent voiced speech signals while pole-zero 



models are needed for unvoiced speech signals [2]. However, when the prediction order p is high 
enough, all-pole models effectively represent all types of speech signals [3]; thus we only 

V; 

examine all-pole models where the speech signals a linear combination of its past values and 
some input it(n) ^\ 

s(n) = — 2^ a k s (. n ~ ^) (3-4) 

Hence H(z) is defined as: 

™-8w * 



/c=i 



3.1.1 The Liner Prediction Problem 



a 

% 

Linear prediction can be described as a system identification problem, where the parameters of 
an AR model are estimated from the signal itself [4]. A simple block diagram of the linear 
predictive model of the speech signal is shown in Figure 8; where the AR filter is excited by the 
output of a voiced/unvoiced switch. 

15 



From equation (3.4) and assuming that the input u(n) is totally unknown the problem of 
linear prediction is to predict the AR parameters, also known as the Linear Prediction 
Coefficients (LPCs), a k , the^g^in G and the pitch period that correspond to the speech production 
model that best approximates th^signal s(n) from its past samples. 
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Figure 8. Block diagram of the simplified LPC speeelrproduction model [4] 

The approximated signal s(n) is thus defined as: (\ 

c 

v <S> 

s(n) = - > a k s(n - k) # 

X 

Then the prediction error, referred to as the residual, is: 

e(ri) = s(n) — s(n) = s(n) + ^ a fc s(n — /c) 

o 

Using the method of least squares, the LPCs are found by minimizing the md^ squared error 

E = £{e 2 (n)} = £^s(n) + ^ a fc s(n - fc)J 



(3.7) 



o 

O. (3.8) 



£ is minimized by setting its partial derivatives with respect to a fc to zero, 
dE 



- — = 2£ \ f s(n) + a,, s(n — k) ) s(n — i) 

dai V fa / 



0, 



1 < i < p 



(3.9) 
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Rearranging (3.9), we get: 

£ {s(ri)s(j^ — + £ | ^ a k s(n — k)s(n — i)| = 0 

^ ' 1 (3.10) 

£{s(ri)s(n — + / a k £{s(n — k)s(n — i)} = 0 

Equation (3.10) can be written in terras\of the autocorrelation and is known as the LPC analysis 
equation: 

<$> 

^a k «(i -k) = ~m)><, 1 < i < p (3.11) 

where is the autocorrelation of the signal s(n^^d 

«(i - k) = £{s(n - k)k(n^- i)} (3.12) 
Expanding (3.8) and substituting (3.10), the minimum av^^e error is given by 

E = £{s 2 (n)} + 2_^ a k £{s(ri)s(n -.fc^ (3.13) 

This derivation is valid for stationary signals, deterministic) or random; however, the 
speech signal has a dynamic nature making its characteristics vary~^h time. Therefore, LPC 
analysis must be performed on frames of speech where the signa^ statistical properties 

are almost unchanged. Thus the LPCs are calculated for every signal frame using the above 
procedure since the signal is believed to be locally stationary within that frarr^e^To emphasize 
that the analysis is performed every frame m of the signal s(n), a subscript, m, wilf-be added to 
the signal, residual and autocorrelation expressions. Rewriting the predicted signal, the 
prediction error and the LPC analysis equations: 
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Sm(n) = - V a k s m (n - k) (3.14) 



k = l 



e m (n) = s&n) - s m (n) = s m (n) + ) a k s m (n - k) (3.15) 



k=l 



^s m (n)%(n - > a k £{s m (n - k)s m (n - i)} = 0 (3.16) 



9=1 




where, R m (i - k) = Sj^in - k)s m (n - i)} (3.17) 

^a^Ji-fc) = -Mj), 1 < i < p (3.18) 

= «m(0) + ^ (3.19) 

where m is a frame of N samples. Typically the frame length N is of 16 to 32 ms of speech [4], 
which is 128 to 256 samples at a sampling frequency of 8 kl^A longer frame has the advantage 
of less computational complexity and lower bit-rate, since the^lculation and transmission of 
LPCs are done less frequently. However due to the changing nature^of speech, the LPCs derived 
from longer frames might not be able to produce good approximation v ~o^<the speech. 

o 

3.1. l.a. Linear prediction coefficients (Autocorrelation method) 

Linear prediction coefficients can be solved for using several methods; one(p)f which is the 
autocorrelation method [3]. The main advantage of this method is its stability [6]; y ^Jiere all the 



roots of the polynomial A(z) fall inside the unit circle and thus the system H(z) in Equation 
(3.5) is guaranteed to remain stable. The method's name comes from the autocorrelation term in 
Equation (3.18), which can be written in a matrix form as: 
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(3.20) 



equivalently, 



RmiO) 



4 



CD 

^0) 



Rm(.P ~ 1) 

R m (p - 2) 













a 2 




Rm(2) 




- a p . 




Rm(p). 



(3.21) 



Equation (3.20) can be solvetLfor the LPCs, a, by finding the matrix inverse of R m ; 



unfortunately, matrix inversion is gen^lly expensive in terms of computation specially for 
higher p. However, efficient and neat recurve algorithms have been developed to solve (3.20) 
taking advantage of its elegant structure. Durban's recursive procedure is believed to be one of 
the most efficient algorithms to solve the LPC analysis equation [3]. 

Durbin's recursive Algorithm [6]: S 

c 

• Initialize: = ^m(O) ^ 



for i = l,2,...,p 



R m (0 + Z%\ a} l_1) R m (i -#i 



a i 


= *i 






a® 
j 


= Q 1 




1 < < i 


p(£) 

'-m 


= (1 






end 








• Final solution: 


dj 




< p 



% 



where ttj's are known as the reflection coefficients 
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It can be noted that in obtaining the solution for a predictor of order p, one actually 
computes all the predictors of order less than p. Furthermore; at each step i, the minimum total 

error ', is calculated and mps can be monitored as the predictor order is increased. 
3.1. l.b. Computation of the gain^ 

The speech production model in Fi(*j^e 8 shows the model gain as a scalar factor that is 
multiplied by the input u(n) to assign the^frame energy. Equation (3.4) relates the gain factor to 



CO 

the LPCs as: V*> 



Gu(n) = s(n) + £jfcs(n - k) (3.22) 



where u(ri) is either a unit impulse 8(n) for voiced ^aech or a zero mean unit variance white 



noise for unvoiced speech. The gain G is therefore derivefyfor the voiced/unvoiced cases. 



peec 



For voiced speech, u (n) = 8(n) and equation (3.22) can be written as 

GS(n) = s(n) + Y a k s{n - k) \S (3.23) 
ti O 

Multiplying (3.23) by s(n) and summing over n: \§\ 

p o 

G^s(n)8(n) =Y j S 2 (n) + ^a k ^s(n)s(n-k) (3.24) 

n n k=l n # 

at n = 0, from (3.23), s(0) = G and thus the left hand side of (3.24) is G 2 

G 2 = R(0) + Y a k R(k) (3.25) 

k=l 

For unvoiced speech, u(n) is white noise with £{u(n)} = 0, £{it 2 (n)} = 1. Writing the 
autocorrelation function for the speech signal: 
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R(i) = £{s(ri)s(n - i)} 
p 



R(0) = G£\u(n) 



Gu(n) -rry a k s(n — k) 



G 2 = R(0) + ^ a k R(k) ®* 

/e=l 



(3.26) 



R(i) = G£ju(ri)s(n — i)} — y a k £{s(n — i)s(n — k)} 
4* hi 

At i = 0, ^ 

V 

i?(0) = G£{u(>aJ>s(n)} - ) a k £{s(n)s(n - k)} (3.27) 

^a fe i?(/c) (3.28) 

/c=l 



i?(0) = G 2 £{u 2 (n)} -G^a k sQ(n)s(n - fc)} - ^ a fc 7?(/c) (3.29) 

k=l /c=l 

Since u(n) is independent of s(n — k) 

P p 
R(0) = G 2 £{u 2 {n)} -G^a k £{u(n)}£fs«^ k)} - ^ a k i?(/c) (3.30) 

k=l (^) /e=l 

Hence, 

v ^ 

«(0)= G 2 -^^^) ^ 



Which is the same result obtained for the voiced speech case in equation (3.25). 
3.1. I.e. Pitch period estimation 

In the case of voiced speech frames, time length between consecutive excitation impulses is 
known as the fundamental period or the pitch period. For men, the possible pitch frequency 
range is usually between 50 and 250 Hz, while for women it is between 120 and 500 Hz [1]. 
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Pitch period estimation is essential for LP coding because the periodic excitation for voiced 
sounds is generated by switching an electric switch on every pitch period. Hence it is important 



to accurately estimate the pfj£h period in order to synthesize a high quality speech. 

There are several ways^Aestimate the pitch period of a frame; one of the most common 



methods uses the autocorrelation l^^iction [1]. The autocorrelation function R{l,m) is calculated 
for the speech frame s(n) of length i^^at ends at the time instant m. 

R(l,m) = ^ s(ri)s(n-l) (3.32) 

n=m-yMj-l 

where I is the time lag. V* . 

The autocorrelation is calculated over the entire ran^e^of lag, from 0 to N, and the pitch period is 
the lag that corresponds to the highest autocorrelationY*^ 

Another way that is more preferable since it d^sn't require multiplications that are 
considered computationally expensive uses the Magnitude Difference Function (MDF) which is 
calculated using a similar formulation as (3.32) but with a subtraction instead of a multiplication. 

MDF(l,m)= ^ |s(n) -s(n- 01 (3.33) 

n=m-N+l 

The pitch period in this case is the time lag that corresponds to the lowest TC1DF. 
3.1.2 The Linear Prediction Coefficient Vocoder Q\ 

% 

Once the linear prediction problem is solved and all the LP coding parameters (voicing decision, 
pitch period, model gain and LPCs) are found, the model shown in Figure. 8 is fully defined and 
the parameters are ready to be properly quantized and sent over the transmission channel. 
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The voicing parameter, pitch period and the gain are directly quantized, coded and sent 
over the channel. 1 bit is enough to quantize the voiced/unvoiced parameter, 6 bits are sufficient 
to quantize the pitch period, 1 *^! about 5 bits are required for quantizing the gain [3]. 

However, the LPCs are^ery sensitive to quantization; small changes made to the LPCs 
may result in the filter being unstafojfc, which means more bits are needed to adequately quantize 

V 

them. It was found that almost 8-10 bi^yer coefficient are required to quantize the LPCs with an 
accepted accuracy [3] which is not effid^ for low bit rates. Therefore LPCs are not quantized 
directly, instead a proper representation m^^is less sensitive to small changes is quantized. 



Representations such as line spectra, frequen^SF), the predictor poiynonria, roots and the 



reflection coefficients had been introduced and useoj^r LPC quantization coding the LPCs with 
about 40-50 bits [7]. 

For a frame of about 30 ms almost 65 bits arl^Pe^uired to code all the LPC model 
parameters resulting in a total bit rate of about 2.2 kbits/sec (^)|. The LPC model has a relatively 



low computational cost and results in a low bit-rate speech cod{n}g. However, the LPC model is 
also highly inaccurate in various circumstances resulting in a low qutd^ty synthetic speech. 

laS^ufi 



One of major limitation of the LPC model is due to the misclass^fif ation of speech frames 




into strictly voiced or unvoiced, as discussed in Section 2 of the previous qh^pter. Misclassifying 
the speech frames results in an incorrect modeling of the LP filter excitationSby strictly random 
noise or strictly periodic impulse train. This inaccuracy in the voicing decisio^tjius results in 
annoying artifacts such as buzzes and tonal noises in the synthetic speech [1]. V *^ > 
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3.2 



MULTI-PULSE EXCITED LINEAR PREDICTION CODING 



Multi-pulse excited linear p^diction coding (MPLPC) was first introduced by Atal and Remede 
[5] as a new speech production^pdel that generates natural sounding speech at a low bit rate. As 
the name implies, the excitation* signal of the MPLPC consists of a sequence of pulses whose 
amplitudes and positions are selectecMbsminimize an error criterion with no preference or a priori 
knowledge of the voicing nature of the sp^ch segment. 

Figure 9 shows a block diagrarn^^ the MPLPC. The diagram is similar to the 



conventional LPC one; the only difference is the absence of the voiced/unvoiced switch and the 
quasi periodic/white noise generators which are repjaced by a multi-pulse excitation generator. 

Pulse „ u .. 



Amplitudesand 
Locations 



Filter 
Coefficients 



6 



ii 



Synthetic Speech 



Excitation 
Generator 




Time Varying 
Filter 




w 









Figure 9. 



Block diagram of a MPLPC speech synthesis model [8] 




The excitation signal is a sequence of pulses located at times--yi 1 ,m2, ... , m^-with 
amplitudes g^g^, — ^k- The K pulse amplitudes and locations are sent every frame over the 
transmission channel along with the filter coefficients. The multi-pulse signar-js^then used to 
excite a synthesis filter to reproduce the speech signal. 

The time varying filter is typically a linear prediction all-pole filter whose coefficients are 
obtained as described in Section 3.1. The pulse amplitudes and locations are found by an 
analysis-by-synthesis procedure [5] shown in the block diagram of Figure 10 where a multi-pulse 
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signal is used to excite an LPC filter which generates a synthesized speech; the synthetic speech 
is compared to the original speech to produce an error signal which is then properly weighted 
and used as an error criterio^jThe pulse locations and amplitudes are found so they minimize the 
mean squared weighted error. ^ 



Amplitudes and 



s(h) 



Error 
Minimizer 


/ , 


Excitatior^ 
Generator 


v (n) 


LPC 
Synthesizer 


s(n) 




57 


— i 




•0 



e(n) 




Weighting 
Filer 



Figure 10. 



WeighteHf"Error 

Analysis by synthesis block diagram for filming amplitudes and locations of multi-pulse 
excitation [5] \* 

o. 



Atala and Remedy [5] suggested that since energ'y^- highly concentrated in the formant 



regions, one can tolerate more error in those regions than in regions in between them; therefore a 
weighting filter is placed to de-emphasize the error in the If^nant regions. The frequency 
characteristics, in the z-transform, of the weighting filter is given byO 

where are the LPCs and r is a fraction between 0 and 1 that controls th^rror increase in the 



formant regions. The value of r is determined by the degree to which orfeXvishes to de- 

a 

emphasize the noise in the formant regions; setting r to 0.8 at a sampling rate of 8 is proved 



to be suitable [5]. 
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3.2.1 Pulse Search Procedure 



The amplitudes and locatioa^pf the excitation signal are found such that they minimize the mean 
squared weighted error. The sygfliesized signal is expressed in terms of the multi-pulse excitation 



sequence of amplitudes g t and locations rrij as 

sW^ft.^-^D (3-35) 

where h(ri) is the impulse response of the BPC filter. 

Using a weighting filter W(z) with an irrtpulse response w(n), the total weighted squared 
error between the original and synthesized speech W 



' ^ ' (3.36) 



n=0 I i=l \> 

6 



where 

s w (n) = s(n) * w(n) ^ 

y> (3.37) 
h w (n) = h(n) * w(ri) Q 

Finding all the amplitudes and locations at once is extremely^pmplex therefore a sub- 

optimal procedure was proposed [5] where the pulses are searched for one/pulse at a time over a 

short time segment, typically 5 to 10 ms, where when searching for the pulse /c, one assumes that 

all the previous k — 1 pulses amplitudes and locations are known. 



Minimizing (3.36) with respect to (^(setting the derivative to zero), g k is found to be: 

_ Rhx(jn k ) - I,i=l giRhhOnk.mj) 0 < m £ 

9k R hh (m k> m k ) ' m k <N-l ^ > 



where, 



26 



N-l 



Rkxfak) = ^ s w (n).h w (n -m k ) , 0 < m k < N - 1 (3.39) 



71=0 

J-l 




0 < m 

R hh (m k , rrii) = jLh w (n - mj). h w (n - m k ) , m . < N 1 1 ( 14 °) 



Pulse Search Algorithm [81 : r v 

• Initialize: i?(m) = R hx (m) for*0^< m < N — 1 

• Search: /or k = 1 : K ®. 



Find the pulse locatibji^gi/,. that maximizes |i?(m) | 



a Find the pulse amplitudes/fusing (3.38) 
□ Update: R(m) = R(m) - fak^im - m k ) 
end O 
This is a basic pulse search process, where the pulse that n(Khimizes the total error is searched 



for, then its contribution to the error is subtracted and the next pv^tsje is searched for. 

O 

3.2.2 Improved (Amplitude Updating) Pulse Search Method 

It was observed that finding the amplitudes and locations of the pulses in a successive manner is 
inaccurate for closely spaced pulses; however avoiding this inaccuracy is possible by updating 
all the amplitudes after obtaining the positions so that the updated amplitudes minimize the error 
criterion [9]. 

Finding the derivative of (3.36) with respect to gj and setting it to zero 
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^ djRhhOTT-umj) = R hx (mi) , for 1 < i < 



K 



(3.41) 



Given that all the pulses lotions are now known, the updated amplitudes are found by solving 



(3.41) fork's. 



The MPLPC model is showj^o, produce high quality natural sounding speech at medium 
bit rate, 10 to 16 kbits/sec [8]. FigureQ^b below shows the effective performance of the MPLPC; 
a speech signal is well modeled by tn^multi-pulse excitation signal resulting in a speech 

CO 

waveform that well approximates the origina^jgnal especially the pitch characteristics. 



(a) Original Spqecl 



(b) Multi-Pulse Excitation 



6. 



\ \ \] \ \ \ 



(c) Synthesized Speech 



'-6 



Figure 11. 



(d) Error Signal 

Waveform illustration of the MPLPC coder 



O 



3.3 ROBUST LINEAR PREDICTION CODING 



As described in Section 3.1 LP finds the inverse filter coefficients a k 's such that A{z) = 1 + 
+ £fc=i 0-k z ~ k - Passing the speech signal through A(z) results in the residual signal e(n), which 
represents the pitch information in the speech. On the other hand, the magnitude spectrum of 
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l/i4(z) describes the spectral envelope of the speech signal thus contains formant information 
[10]. This is illustrated in Figure 12 which shows a residual signal of a voiced speech segment 
(a) and the spectrum of the sjlme speech segment and the LP filter (b). 
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Figure 12 



1 1.5 2 2.5 

to (rad/sample) 
Pitch and vocal tract information captured by LP analysis^^ 

(a) Pitch information in the residual signal (b) Formant intjfirmation in the filter coefficients 

vP- 

The success of LP methods depends on determining the coefficients a fc 's such that 



A(z) best captures the vocal tract information and the LP residual contains^t^pitch information. 
Further, LP methods must be robust to noise so that the vocal tract information^well extracted 
even for noisy speech. It has been observed that the conventional method of LP^jglysis based 
on squared error is sensitive to noisy speech [11]. 

The Robust Linear Prediction (RBLP) procedure takes into account the non-Gaussian 
nature of the source excitation for voiced speech by assuming that the innovation is from a 
mixture distribution, such that a large portion of the excitations is from a normal distribution 
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with a small variance while a small portion of the glottal excitations is from an unknown 
distribution with a much bigger variance [12]. 

The RBLP proceduf^minimizes the sum of weighted residuals, rather than minimizing 
the sum of squared residuals. T^assigned weight is a function of the prediction residual and the 



cost function can be selected to a^lgn more weight to the bulk of small residuals while down- 

V 

weighting the small portion of large rqsjduals. 

A robust estimate of the LP confidents is hence obtained by solving the following 



optimization problem [12]: 

N X^s 

U = min ^ pQM) (3.42) 

n=p+l 

where, e n (a) = s n + ^ a k s n _ k C\ n = p + 1 , ... ,N (3.43) 

k=i 

pipe) is an appropriate loss function that has a bounded derivative, psi-function, i/^(x) = p'(x). 

Huber's psi- function, ip H (x), is used to find the fl^imum due to its robustness 
properties since the function is bounded monotonically non-decreas@g, which yields uniqueness 
[12]. The effect of using t/^ (x) is to assign less weight to the small potion of large residuals so 
that the outliers will not terribly influence the final estimate, while givirrg)unity weight to the 
bulk of small to moderate residuals. Huber's psi is defined as: 



ip H (.x) = min[c , max(x , — c)] (3.44) 



where c is an efficiency tuning constant. 

The associated Huber's loss function is thus defines as: 



r \ f* 72 if 1*1 < c 
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In other words, Huber's loss is a quadratic function in the middle and an absolute value function 
at the tails, which results in more minimization of the small errors while allowing large errors to 



grow larger. Setting the derivative of (3.42) to zeros, 

N <£a 

2^ s„_ ; -V(e„(a)) = 0 7 = 1,2 p (3.46) 

n=p+l \$\ 

V 

The LP coefficients a are found by s^jing the set of non- linear equations (3.46); the following 
sub-sections discuss two different approai^s for the solution. 

9s 

3.3.1 Solving the RBLP problem by Iteratftfejieweighted Least Squares Algorithm [12] 

The system of non-linear equations in (3.46) requires iterative methods to solve for the 

o 

coefficients. Given a preliminary estimate a (usually the ©conventional LPC). 

o 

Often, i/j'(x) is approximated by a weight function W(x), wh^re 



W(x) = Mx)/x *^ (3.47) 



Weighting the residuals by VK(x) in the estimating equation, Equano«j(3.46), we get, 



n=p+l 



where k is the iteration number and e n (a) is residuals defined as in (3.43). 



Defining C** and c** as: O 

c;;= ^ ^Vi^ 1 ' 1 )) i<U<p 

n=p+l 

(3.49) 



c/*= ^ s n _, s n f(e n (a«)) l<;<p 



n=p+l 
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(3.48) can be written in a matrix form as: 

C** a ( fc+1 ) = -c** (3.50) 

And the RBLP solution is ^\ 

■£» a (* +1 > = -(C") _1 c" (3.51) 
Hence, the algorithm simply rew^ights the residuals e n (a) by a proper weighting function 
VK(e n (a)) and generate a weighted c(j^rjance matrix C** and a weighted correlation vector c** 
then solve for a by matrix inversion. (^) 

3.3.2 Solving the RBLP problem by Weigm^kLeast Absolute Value Minimization [11] 

V 

The LPC's in this method are found so that they minit^-fcze a weighted absolute value of the error. 
Thus, a is the solution to the following £1 minimization problem: 

a = min > w(n)\e n (a)\ . (3.52) 

a Z_i > 

n=p+l 

where w(n) is a Hamming window weight. q 

This problem is set as a linear program that is solved by the simplex m^^pd described in [13]. 

3.3.3 Stability of the RBLP Algorithms O 

o 

As mentioned in Subsection 3. 1.1. a, the autocorrelation method guarantees stajj^lity of the 
resultant system [6]. RBLP procedures, however, do not assure stability and hence require 
stability checks. If the RBLP algorithm produces an unstable LP filter with A(z) having roots 
outside the unit circle, then the procedure can be stopped, and the stable preliminary LP filter is 
then used in the synthesis filter. 
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4.0 COMPRESSIVE SAMPLING 



Compressive Sampling (CS),'apso known as Compressed Sensing is an emerging technique for 
data acquisition that promises* ^mipling a sparse signal from a far fewer number of 
measurements than its dimension. fE^was motivated by the desire of sampling and compression 
simultaneously, instead of spending too^much effort on sampling than throwing away most of 
what is sampled in the compression stage, t^ite technique was introduced by David L. Donoho in 
2006 [14] and has attracted attention ever since: In 2008 Emmanuel J. Candes and Michael B. 

<> 

Wakin [15] fully introduced the developed methodTto the signal processing society as a scheme 
that offers more efficient transmission, reception, and^jsrrage of data. 

c 

Compressed sensing is based on the idea that^one can sufficiently capture all the 
information in a sparse signal by sampling only part of the si^al using a sampling domain that is 
incoherent to the signal representation domain. A block diaglap^ of the compressive sampling 
technique is shown in Figure 13 below; later sections of this c^fiagter will fully explain each 
process of every block. 
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Figure 13. 



Block diagram of the compressive sampling procedure 
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This chapter is organized as follows. Section 4.1 introduces the concept and the 
mathematical representation of sparsity and incoherence as the two basic concepts of 
compressive sampling. The^ampressed sensing problem and the algorithms used to solve it are 
addressed in detail in Sectio*£j4.2; followed by a discussion about compressive sampling 
op timality in Section 4.3. ^ 

X 

4.1 SPARSIT® AND INCOHERENCE 

Compressive sampling relies on two important ""properties; one is related to the signal that is 
about to be sampled (sparsity) and the other is related^ the sampling domain (incoherence). The 
compressed sensing method is interested in highly spars^ejjignals and highly incoherent sampling 
domains [16]. We now set the definition and mathem&kjal representation of sparsity and 
incoherence. • > 

o 

4.1.1 Sparsity 

Signals that are mostly populated with zeros and have a small number o -zero components 
are called sparse signals. An example of a sparse signal is the multi-pulss excitation signal 

o 

discussed in Section 3.2; where the excitation signal is mostly zero with few nonzero pulses. It 
was discussed in the previous chapter that such an excitation signal is sent over the transmission 
channel by quantizing and sending only the amplitudes and locations of the non-zero pulses. 
Sparsity hence allows efficient compression, interpretation, estimation and computation and thus 
plays a key role in compressive sampling. 
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Mathematically speaking, let / G M N be an iV-dimensional signal that is represented in a 
proper orthonormal basis W = {xp^ xp 2 , ... , tp N ], (i.e. tpi's are orthogonal unit vectors) 

/(O^O^iW < t = l,2 N (4.1) 

where x is the coefficients sequeno^tof / and V; is an iV x 1 column. 

V 

Equivalently, q£ 

/ =^ and x £ = (/, .) (4.2) 
If we define f T = W x T , s\ 

V' 

/ r (t)= ^x r .^(0 ^ t = l,2 N (4.3) 

i=i A 

where, x r is the vector of coefficients (xj with all bXit^he T largest coefficients set to zero. In 

other words, x T is a sparse vector with only T non-zero efefp^nts; x T is called T-sparse. 

If x is well approximated by x T , then the error ||x — @||^ is small. However, W is an 

orthonormal basis and hence, ^ * 

X 

V-fA^Wx-XrK ^ (4.4) 

Therefore / is well approximated by f T (/ ~ />)• This means that if ^^parse, one can throw 
away a large fraction of the coefficients (x £ ) without much loss in /. 

An example where the loss in / is relatively small is shown in Figure 14^vhich shows a 
very dense audio clip in the time domain (a) and its sparse representation in the ol^ete Cosine 
Transform (DCT) basis (b). Since the largest DCT coefficients carry most of the energy [17], 
only the coefficients corresponding to 97% of the signal's energy are kept and the rest are 
discarded; which is achieved by zeroing out the smallest 83% of the DCT coefficients. Figure 14 
(c) shows the audio clip reconstructed from the largest 17% of the DCT's. 

35 



Time Domain (Original) 



DCT Coefficients 




Figure 14. Sparse signal recovery, (a) Original signal, 5 sec Audita clip of Handel's Messiah (b) The 

discrete cosine transform coefficients of the signal (c)«The reconstructed audio clip from 
the 17% largest DCT's (d) The error signal ^\ 

Hence, a simple method for data compression would be^-^ompute x from / then 
(adaptively) encode the locations and amplitudes of the T most sign^eant coefficients. This 
principle actually underlies many modern lossy coders [15]; however, confp^sive sampling is a 
different concept where the sparsity of the signal has significant bearings T)n_t.he acquisition 
process itself; sparsity determines how efficiently one can (non-adaptively) acquiiCXsignal [15]. 

Not all signals are sparse by their nature; however most signals are sparse when 
expressed in the proper basis. Therefore it is very important to find the (right) basis where most 
signals of the same nature are sparse in order to be able to perform compressed sensing 
independently on the signal. 
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4.1.2 Incoherent measurement basis 



Incoherence extends the ckfcdity between time and frequency expressed in the uncertainty 
principle to the duality betweej^the signal's sparse representation and the domain where it is 
sampled [15]. Just as a Dirac oY^ spike in the time domain is spread out in the frequency 
domain, a signal that has a sparse representation in W must be spread out in the domain O in 
which it is acquired. Put differently, lH^herence says that unlike the signal of interest, the 
sampling waveform has an extremely dense^j^resentation. One good example of a sparse/dense 
pair is sampling a sequence of Dirac pulses (ve\^j|parse) in a sinusoidal basis (very dense). 

In order to take m measurements of a 'ft^or / G E w we sample / in the sampling 
domain O, where 4> = {<p lt (p 2 , ... , (Pn) and (p t is an >^x 1 column. The measurements signal is 
therefore defined as: O 

y(.k)=2_ i f&VtW, k = \,i, m (4.5) 

The coherence between the representation matrix W and the>peasurements matrix <P is 
defined as [18] 

V) = ViV max \(<p k ,Tpj)\ q (4.6) 

<* 

If <P,W are normalized such that H^mxwl^ — ll^wxwl^ — 1 • 

o 

Then (<Pk,*l>j) < 1 ^ < ViV Q 



N 

However, ^J(<P/c, V^f = 1 - k = l,2,...,N 

1 

thus (<p k ,xpj)>— n>l 
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£ [l.yfN] (4.7) 
As discussed in the next section, the smaller the coherence between O, *F the fewer 



measurements are taken by v^and hence the term "incoherence" is used. 

Random matrices are Widely used as sampling bases O in CS applications; that is 
because CS is concerned with highjhcpherence and random matrices are largely incoherent with 

V 

any fixed basis V [15]. White Gaussia{l£)or uniform noise thus make good sampling bases for CS 
[19] and are widely used as the CS measurement basis. 

Now that the foundation of CS is laid, we moph on to formulating and defining the CS problem. 
4.2 THE COMPRESSIVE SAMPLING PROBLEM 

% 

The compressive sampling problem asks two basic questions, how many measurements are 
needed to fully capture the information in the signal? and wha^nsethods are used to recover the 
data from the undersampled measurements? 

The first question was answered by Candes, Romberg, and Tj^[20] who suggested that 
to capture the information in the signal with a probability of 1 — N ¥£jMiere M is a positive 
constant, one needs to take a number of measurements m that is proportiona^ro both the sparsity 
level T and a log factor of the signal dimension N. Q 

m > Const M T log(iV) ( 4 - 8 ) 
This result was then enhanced to [15] 



m>C /U 2 (0, V) T log(iV) (4.9) 
where C is some positive constant and fJ.(^,W) is the coherence. 
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Further simplifications are made when the sensing basis is highly incoherent with the 
representation basis, e.g. when taking O as white noise, then the coherence term can be absorbed 
in the constant C, and m carizbe simplified to 

X 

• m>CT log(iV) (4.10) 

The second question was tackled by many ways and the literature is rich with algorithms 

that are developed to recover highly incwjaplete information. The methods of finding the solution 

to the CS problem generally fall into two ctoses, methods which use linear programs to recover 

<> 

the data (basis pursuit) and methods that tusp* second order greedy algorithms (orthogonal 
matching pursuit). \j r\ 

4.2.1 Solving the CS problem using basis pursuit algorithms (€-1 minimization) 

The £-1 minimization approach, also known as Basis Pursuit (BP) algorithm, is one major 
approach to solve the CS problem and was presented in the early^C^S work as the best algorithm 
for sparse signal recovery. 

THEOREM 1 [15], [18] O 

Let / G M, N be an N dimensional signal that is T-sparse in some basis *F (i. e«/ = x and x is 

o 

T-sparse). Collect m measurements independently and randomly in a white G^^sian domain 
<P such that 

m > C T logOV/T) (4.11) 

where C is some positive constant. 
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Then it is possible to reconstruct every T-sparse signal x (and hence recover /) with a 

probability exceeding 1 — e~ cm (where c is a constant different from C) by solving the following 

convex optimization problef^^ 

x = mi^Jall! subject to y= 4>¥jc (4.12) 
an'd J = W x 

where y is the vector of sampled measurements y = <P f and / is the reconstructed signal. 

An important detail in the iS^jpproach is that a particular choice of the Gaussian 
measurement matrix <P succeeds to recov^^very T-sparse signal with high probability [21]. 

Below are two examples of the t-\ r^nmization recovery results. Figure 15 illustrates 
example I, where a sparse signal of length 512 v ^ith only 20 non-zero +/- perfect unit pulses 
placed randomly is recovered using compressiv^ sampling. The signal was successfully 
recovered from only 120 measurements taken randomly^m a white Gaussian basis. The obtained 
SNR is overwhelmingly high, 218.41 dB, for a compressioi^fector of 0.23. 

Figure 16 illustrates example II where the signal is a # 512 vector with T=128 non-zero 
elements that are not perfect unit pulses, rather they are dra^ri randomly from a normal 
distribution and placed at random locations. The results show an Sact recovery with SNR of 



179.9 dB when taking only 384 measurements. This is a case where theS^mber of measurements 
is only 3 times the sparsity level T (less than T log N ), yet the recoveryQ^uccessful with an 
overwhelmingly high SNR. 

o 

% 
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Figure 15. 



Figure 16. 
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Sparse signal recovery using ^l-mmimization - example I 

(a) The original sparse signal (b) Thesignal exactly recovered by CS collecting only 120 
measurements J 
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The Basis Pursuit algorithm guarantees recovery of the sampled signal ^th a very high 
probability of success. However, since the algorithm solves an iterative linear^fogram, the 
computation expense of solving the CS problem using BP algorithms can be high 
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4.2.2 Solving the CS problem using orthogonal matching pursuit algorithms 



As mentioned above, the ^L, minimization approach can be expensive in terms of time and 
computation especially for la^e data; Orthogonal Matching Pursuit (OMP) algorithm was 



therefore introduced (along witfi^jpme other greedy algorithms) to minimize the time and 
computation cost of solving the CS problem. 

\ 

THEOREM 2 [21] 

Given a signal / G M, N that is T-sparse in *F, fh^f G (0 , 0.36) and choose m such that, 

*> 

m>CTlog(mS) (4.13) 
Then / can be recovered from m measurements draw^ Independently from a standard Gaussian 
distribution with a probability that exceeds 1 — 28 by spying the following £-2 minimization 
problem: 

2 = min \\y - O W x\\ 2 subject to H^lt^ T 

y> (4.14) 
and f = ¥x Q 

The idea behind the OMP algorithm is to pick columns in a grisly fashion [21]. Let the 

sensing matrix O = {q) 1 , <p 2 , ... , (Pn) where <pi is an m x 1 column. At each of the T iterations, 

select the column q> t that is most strongly correlated with y; then subtract off its contribution to 

\ 

discussed in Section 3.2 where the number of pulses searched for is fixed to 7\<The greedy 
algorithm as introduced by Tropp and Gilbert in [21] can be summarized as: 

1 . Initialize the residuals r 0 = y , the index set A 0 = 0 , the matrix of chosen atoms 
O 0 = 0, and the iteration counter t = 1. 



y and iterate on the subtraction residual. It is actually a search process very sir^iipr to the one 
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2. Find the index A t = argmax ;=1 w|( r t-i'^;)|- 

3. Augment the index set and the matrix of chosen atoms: 

A t = A t -i U^} and O t = [4> t _! (p h \ 

4. Solve the basic least squires problem to find a new estimate: s t = arg min||y — O t s|| 2 

• s 

5. Calculate the new data appropriation and the new residuals: 

a t = <P t s t and r t = y^ t 

6. Increment t and go to step 2 if t 



7. The estimate x has non-zero elements<i5nLy at the indices listed in A r . The value of x in 
component Aj equals the jth component 

Figure 17 illustrates example I, the same example in Figure 15, where a 512 samples 
signal is recovered from only 120 measurements but thisJime using OMP algorithm. 
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Sparse signal recovery using OMP algorithm, example I. (a) The original sparse signal (b) 
The signal recovered by CS collecting only 120 measurements 
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Observing Figure 17.b, one can notice that the algorithm fails to recover spikes 12 and 20; 
further, the amplitudes of other recovered spikes are notably different than the originals. This 
degrades the SNR to 9.32 dB^eompared to the 218 dB obtained using BP algorithm. 

The run time and computation cost of the OMP algorithm are far less than for the BP 



approach; however, OMP is weake^rjljhan BP for many reasons [21]: 

• More samples are needed for^^JP than for BP for a successful recovery. 

• The probability of success is smal^ for OMP than the one for the BP. 

• The quantifiers are ordered differerh^) whereas OMP recovers each sparse signal with 
high probability but with high probabiri^ fails to recover all sparse signals, BP shows 
that a single set of random measurement ve^>^s can be used to recover all sparse signals. 
In other words, OMP solution is non-uniform m^contrast to BP solution. 




200 250 300 

Number of measurements 



Figure 18. BP vs. OMP performance for the signal of example I 
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Figure 18 illustrates the above points on example I. The plots compare the performance 
of OMP to that of BP using the same signal and the same sensing matrix. It is clear that both 



approaches result in an ovqsvhelmingly high SNR (higher than 150 dB) when taking enough 
measurements. It is also clear tgjjt OMP needs more samples, to achieve its high SNR, than the 



number of measurements BP na^fc; which makes the performance of BP better than the 
performance of OMP especially attfjsfrev compression factors. However, in some applications 
high performance is compromised by ihsv run time and the computation cost making OMP 
algorithms some times more practical. 

4.3 OPTIMALITY OF COMPRESSIVE "SAMPLING TECHNIQUES 

% 

CS as mentioned above, assures the recovery of undersafn^ed signals with an overwhelming 
high probability if the signal of interest is sparse in some basis sampled in a random domain 
0, if the number of measurements m is chosen according to bjfuation (4.10) and if the £-1 

o 

minimization approach is used. However there exist some very e^Jpfeme cases where all the 
conditions are satisfied and yet CS fails to recover the signal with high portability. 

One very simple example is a signal x that has only one non-zero element. In this case, 
with high probability, the £-\ minimization approach returns a signal x that pi^uces the same 
measurements signal, y = O x = Ox, but has a lower £-1 norm than x. Figure^* shows an 
experiment that illustrates the CS failure of recovering a single pulse signal. The signal in Figure 
19 has a single unit pulse and 511 zero elements. The number of measurements was calculated 
according to (4.10), m> C T log(iV), with C = 2, T = 1 and N = 512. 13 measurements were 
taken; the experiment was run 100 times and 7 attempts to recover the signal failed. 
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Figure 19. CS failure to recover a single sp{jp) signal (a) Sampled signal (b) Unsuccessful recovery 

The t-\ norm of the recovered sigrfa) is 0.9898 (less than 1) 

% 

The single pulse signal however is nor^e only high sparse signal that cannot be 
recovered, with high probability, using CS. Figure ( 20yjh ows an experiment where the sparsity 
level varies from 1 to 20 for signals with different ffengths. For each signal, m = T log(TV) 



measurements are taken and the probability of success was out of 1000 trials. 




Sparsity T 



Figure 20. Probability of successfully recovering signals with different lengths N and sparsity T when 

taking m= \T log(JV)l measurements 
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The plots in Figure 20 indicate that there is a lower bound for the sparsity in order to 
successfully recover the signal with high probability if the same constant C in equation (4.10) is 
used; the plots further shov/^at^this lower bound is proportional to the signal length. 

Although the probabilit^sf success is so low for some low sparsity signal, these signals 
can still be recovered only if the ^hstant C is increased so that more measurements are taken. 
Which means that C varies depending^! the signal's length and sparsity; i.e. higher C is needed 



for lower sparsity than for higher sparsity^Jn other words, there is a lower bound on the number 
of measurements for CS to successfully reco^efc the signal (with high probability). 

% 
\ 

o 

o 

% 
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5.0 



COMPRESSIVE SAMPLING OF SPEECH SIGNALS 



% 

As described in the introductio^(Chapter 1), the purpose of our work is to take advantage of the 
promising technique of compressHve^sampling to develop an algorithm that applies compressive 
sampling to speech signals in or to transmit them in lower bit rates than the existing 

%< 

algorithms or with the same bit rates but^jvith better speech quality. 

CO 

As stated in Chapter 4, CS techni^es require the signal to be sparse in some basis. 
Speech signals are very dense in the time domafti; further, the domains in which they are sparse 
are neither clear nor straight forward due to the different speech production and classification 
schemes. If we consider the production mechanism described in Chapter 2 and the classification 

o 

of the speech into only voiced and unvoiced signals; we pan consider the voiced signal residuals 

o 

as a suitable sparse domain. As shown in Chapter 3, the speech residuals are sparse for voiced 



sounds and are dense but have a random nature for unvoiced s6"up^s. We can thus take advantage 



of these properties and try to apply CS to the residual signal, obtamed^from LP analysis, and then 
reconstruct the speech signal by passing the CS recovered residualj^hrough the LP synthesis 
filter. x<J 

In this chapter, the compressive sampling technique is applied to th^speech signal. CS 
will be implemented on both clean and noisy speech samples for multiple rn<)le and female 

a 

speakers. Since, as discussed in Section 3.3, robust linear prediction techniques re^lt in better 
approximations for the LPC's; we will apply CS on speech residuals obtained from both 
conventional and robust linear prediction approaches. 

This chapter is divided into five sections; Section 5.1 will explain in detail the 
implementation procedure. The following sections will introduce some implementation results. 
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In Section 5.2, CS is applied on speech residuals obtained by analyzing the speech signal using 
LPC's found by the Conventional Linear Prediction (CLP) analysis; the speech signal is then 
synthesized using the LPC'^md the speech signal is studied and compared to the original one. In 
Section 5.3, the same steps as ^Section 5.2 are preformed; the only difference is that the LPC's 
are obtained by analyzing the sp^ijh signal using Robust Linear Prediction (RBLP) analysis. 
Section 5.4 provides a comparison'^^veen the two approaches used in Sections 5.2 and 5.3. 
While Section 5.5 addresses the issue of^ding the best thresholding method. 

i 

5.1 COMPRESSIVE SAMPLING IMPLEMENTATION PROCEDURE 

The process explained in this section is used throughout the implementation sections unless 
different steps are stated; all implementations are performed using MATLAB. 

As stated above, CS will be performed on the residuals»signal, not on the speech directly. 
The residual signal of a voiced speech frame as plotted in Figure\t2.a is a quasi-periodic signal 

o 

with major large pulses at the pitch period time intervals and so^^ other smaller pulses in 
between. Makhoul and Berouti [22] showed that 41% of the residua^sQmplitudes are almost 

o 

zero. This means that the residuals signal is nearly sparse. They further showed that almost 88% 
of the residual signal is of very small amplitudes. Thus, one can threshold these ^mall amplitudes 
and set them to zero to increase the sparsity of the residual signal without terribi^^ffecting the 
synthesized speech signal. 

CS will be performed on the thresholded residuals, for different threshold levels, and the 
CS recovered residuals will be compared to the original residuals (before thresholding); finally a 
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speech signal is synthesized using the LPC's and the recovered residuals and will be compared to 
the original speech signal. 

The first stage of th^implementation is to segment the speech signal into 30 ms frames 
then find the 12 th order linear p^diction coefficients for each Hamming windowed speech frame. 
The second stage is analyzing the^Jpeech frames to find the speech residuals and the residuals 

V 

variance (power). ^ 

As mentioned above, the residif^^ignal is thresholded for different levels where the 
threshold level is responsible for determinh^the compression factor; we call the thresholded 
residuals signal x to stay in the same notation u^eij in Chapter 4. The sparsity level T is set to be 
the total number of non-zero elements left in the }4sjdual signal after thresholding. The number 
of measurements per frame m is found using EquationX^JO) with the constant C set to 1. 

m = Lriog(JV)J C> (6.1) 

where [-J denotes the floor function. 

Note: This approach provides dynamic computation; frames w5£fj)a large number of pulses will 
need a large number of sensed values and thus a higher computatioi@ effort compared to frames 
with few pulses. \£\ 

The compression factor CF is calculated as the sum of the measured'S^mples m for all the 
frames divided by the size of the original speech signal; i.e. lower compression factors indicate 
more compression. q 

m 1 +m 2 + — h m n ^ 

CF = if ~ ( 6 - 2 ) 

n f N ' 

where m £ denotes the number of measurements taken from the i th frame; and rif is the total 

number of frames. 
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Now that the number of measurements is known, we can apply compressive sampling. A 
matrix O* of size N x N is formed of orthogonal random vectors drawn independently at 
random from a zero-mearf^^it-variance normal distribution and. For each frame, the same 
matrix O* is truncated to formes sensing m x N matrix O that is used to take m measurements 



from the thresholded residuals signify where the measurements signal y is defined as y — 4> x. 

V 

The measurements signal is Sh£n used to recover x. Recovery is obtained by the £-\ 
minimization procedure explained in Su^ection 4.2.1. The minimization is carried out as a 
linear program and MATLAB's linprog ^used to find the solution. The recovered residuals 

V' 

signal x is then used to synthesize the speech sigaaJ using the LPC's found at the beginning. 




nd ihe ( easin g matrix 4> ' 



Segment the speech signal into frames s of lef^grh jV=240 (30 ms) 

j a 



Analvze the speech frames to find the 1 2* order LPC's a. the power g. and the speech residuals e for each frame 



Normalize die residuals power en = e/J§^ 



Find die x by keeping only T pulses from en and setting thej^e^to zero 



^4 



Find the number of measurements m = [T log (AQJ and truncate the 4> ' to ffiffy x n matrix <1> 



3 



Take m measurements from ihe thresholded normalized residuals y = 



Find x by f- 1 minimization 
jc = minlljrllj, subject to y = <1> x 



O 
O 



Find the synthetic speech frames s by passing xjg through die LP filter 



Link the frames s to obtain the synthetic speech signal 5 then compare it to 5 




End 



Figure 21. 



Compressive sampling implementation flowchart 
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5.2 



COMPRESSIVE SAMPLING ON CLP RESIDUALS 



In this section, CS will be allied to the residuals obtained by analyzing the speech signal using 

it 

LPC's found by the classical ly^ar prediction analysis. The LPC's are found using MATLAB's 
lpc function which uses the "autocorrelation method and the Levinson-Durbin recursion 
explained in detail in Subsection 3.Li^ 

Figure 22 below shows an SNR V p^t with different compression factors for four different 
speakers speaking different phrases. A list the spoken phrases can be found in the appendix. 
The plots show the improvement of the SNR* with increasing the compression factor. At a 
compression factor of 1 the SNR grows to value^jever 250 dB indicating exact recovery. The 
plots also indicate that the SNR obtained at the same* compression factor is lower for female 
speakers than for male speakers, even if the environmertwbr the female speaker is noise free. 
This is expected since the pitch of a female speech is high^" than for a male's; and thus the 
residual signal of female speech has more non-zero elements N^ich means higher T and thus 
higher m is needed. Therefore for the same compression factor,^f^Lale speakers require more 




thresholding than male speakers which results in a lower SNR. For-ri^l^ speakers on the other 
hand, the SNR does not improve much (only 1 to 2 dB higher) when^^^king in a noise free 
setting; however, listening tests show better quality synthesized speech when^recording in a noise 
free environment than a noisy one even if the SNR is higher for the noisy environment speech. 
This makes sense because the coding is parametric, not waveform coding; and hence^>SNR is not 
the best criteria to judge the speech quality in this case listening tests are better criterion. 
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Figure 22. CS recovery performance (SNR) for residuals^fttained using CLP 

The plots in Figure 22 represent the total SNR; that i^he SNR of the full length original 
speech and the full length CS recovered speech signal. Howev^ as mentioned earlier, the CS 
process is performed on the residuals signal on a frame by frar^j basis. Therefore the total 
speech SNR is not be a good indication of the success or failure ofTr^CS process. In order to 




discuss the probability of failure that is present in the CS method, a plo£-with the CS process 
input and output is shown in Figure 23 for each frame. The original residuars\re thresholded so 
that the compression factor is almost 0.3. The thresholded residuals are the^rjput to the CS 
system where the recovered residuals are the output of the system. The stairs plo^ls the SNR 



(original residuals vs. recovered residuals) for each frame. 
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Original Residuals 




0.8 1.2 
Time (se^)^ 

Figure 23. Frame by frame comparison between origin^ thresholded, and recovered residuals (CLP) 

with a stair SNR (Original vs. Recovered) plot(Wr Male3 speaker. 

The bottom graph of Figure 23 shows two frames^narked with the vertical arrows) 
where the CS system fails to recover the input signal de^pjte meeting all the method's 
requirements. The failure simply falls in the small probability n?a^n of failure. Investigating 
these two frames we note that the first frame has only 5 pulses in tli^^esholded frame and the 
second one has 6 pulses. Referencing Figure 20 in Chapter 4, the estimate^_rjrobability of failure 
for signals with 5 and 6 pulses is almost 28% and 22% respectively; which fsa high probability. 
Other than those two frames, the CS process successfully reconstructsOts input with 

a 

overwhelming SNR (as high as 200dB); the SNR stairs plot in Figure 23 is opined when 



comparing the reconstructed residuals to the original ones. 

Figure 23 also implies that the SNR for the recovered residuals is low in one of three 

cases. The first case is: the frame is unvoiced and this is expected since the unvoiced frames have 

low sparsity and thus CS is not the best choice to acquire them; however we don't care much 
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about noisy unvoiced frames since unvoiced sounds are already modifications of noise. The 
second case is: the residuals signal is poorly thresholded where the threshold level zeros out 



important pulses. Although ^& work with normalized power residuals so that the same threshold 
can be used for all the frames/^tgime frames still have residuals with lower amplitudes (even at 
pitch periods) than other frames, -^hese lower amplitude pulses fall below the threshold level, 
especially when the level is high (for^jwer compression factor), and hence important pulses are 
zeroed out. This issue can be resolved*!^ decreasing the threshold level or using a different 
threshold for each frame. The third case is^bad luck, the CS process fails to recover the data 
simply because there is always a probability, e^uif small, of failure. 
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Figure 24. 



Residuals and speech signal to noise ratio for each frame of the speech signaO . 
(The speech signal is amplified for the purpose of plotting) \K 



The SNR plots in Figure 23 are of the residuals signal, not the speech. Synthesizing the 
speech of the recovered residuals may increase the SNR, especially for voiced frames and if the 
synthesis filter coefficients best represent the speech production model; or/and it may decrease 
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the SNR especially for unvoiced frames. This can be seen in Figure 24, where the SNR of both 
the residuals and speech is plotted. 



In the next Section, fy& performance of the CS process is investigated when the residuals 
are obtained by the robust linea^jxrediction methods. 

'% 

5.3 COMPRESSI\0O>AMPLING ON RBLP RESIDUALS 

In this section, the CS procedure is investigated'for the case where the residuals are found by 
analyzing the speech using LPC's obtained from f^ust linear prediction methods. The BRLPC's 
are found by the iterative reweighted least squares algorithm explained in Subsection 3.3.1. 

_k 
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Figure 25. 



CS recovery performance (SNR) for residuals obtained using RBLP 
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Figure 25 above shows the SNR plots for the four speakers. As in Figure 22, the SNR 
improves with higher compression factors. The SNR for the female speaker is still lower than the 
SNR for male speakers fof^Dgmpression factors of 0.2 and higher. Also, listening tests show 
better speech quality for speech^gcorded in noise free settings. 

The original, thresholded a^ii recovered residuals at a compression factor of almost 0.3 

V 

are plotted in Figure 26 along with the^siduals SNR. The bottom graph also shows three frames 
where the CS algorithm fails to reconstru^its input; the three frames are different from the two 
ones in the CLP case since the residuals ir^jdifferent. The failure also is a result of having a 
small number of pulses in the thresholded signais^5, 3 and 5 pulses with a probability of failure 
of about 28%, 47% and 28% respectively. As in^e. CLP case, the plots show lower SNR for 
unvoiced frames compared to voiced ones. 
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Figure 26. Frame by frame comparison between original, thresholded, and recovered residuals (RBLP) 

with a stair SNR (Original vs. Recovered) plot for Male3 speaker 
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In the next section, the output of the CS algorithm is compared for the case where the residuals 
are obtained from the CLP and the RBLP. 

\ 

5.4 COMPRESSED SENSING ON CLP RESIDUALS VS. ON RBLP RESIDUALS 

% 

Now that the performance of the CS algdpithm on residuals obtained by both the CLP and RBLP 
methods is investigated, it's time to compaftHhe performance of both approaches. 

Figure 27 shows SNR plots for sp^eph sensed from residuals of CLP and RBLP 
approaches for four different speakers. SNR andM^ening tests indicate that for speech recorded 
in a noisy environment and for female speakers, the^v^nthesized speech quality is better for the 
RBLP case than for the CLP. On the other hand, for sr^eeph recorded by male speakers in noise 
free environments, the speech quality is still better for thevRBLP case; however, the SNR does 
not necessarily improve. • > 

Again, Figure 27 shows a total speech SNR plots. Figures^^ and 29 below show a frame 

o 

by frame SNR for both the reconstructed residuals and the correspor^dij&g synthesized speech for 
a male speaker in a noisy environment and another male speaker in a^mttse free environment, 

o 

respectively, at a compression factor of 0.4. The plots show that for noisy ^feech, the SNR for 
speech synthesized from RBLP residuals is higher than that for CLP residuals ^ almost all the 
frames (voiced and unvoiced). While for clean speech it depends on the classification of the 
speech frame. Voiced frames demonstrate higher SNR for the RBLP case and unvoiced frames 
show higher SNR for the CLP case; while transitional frames show lower SNR for the RBLP 
case and frames of silence show severely low SNR that can be seen in both the RBLP and the 
CLP cases. 
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Figure 27. A comparison between the speech SNR for signets recovered from performing CS on CLP 

and RBLP obtained residuals. > 
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Figure 28. The original speech signal with the SNR obtained from applying CS at a compression factor 

of almost 0.4 on both CLP and RBLP residuals for Noisy/Malel 
(The speech signal is amplified for the purpose of plotting) 
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Figure 29. The original speech signal with the SNR obtained from applying CS at a compression factor 

of almost 0.4 on both CLP and RBLP residuals f<Jr>Clean/Male3 
(The speech signal is amplified for the purpose of^sftting) 

<s> 

Figure 29 above implies that to get a synthetic speech Si^al with high SNR one can use 



RBLP residuals for voiced frames and CLP for unvoiced frames. Such a process requires 
classifying the speech frame into voiced or unvoiced; which alone i^^pehallenge as described in 
Section 2.2. However, dealing with error in the unvoiced frames can always be compromised for 
since theses frames already sound almost like noise. In addition, Figure 29(fs\just an SNR plot; 
listening tests confirm that the quality of the speech for the RBLP case is alwa^better than for 
the CLP. y£> 
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5.5 



FINDING THE BEST THRESHOLD LEVEL 



In the previous sections, thagerformance of the CS process was tested for different speakers over 
different compression factors. Jghe compression factor was found using equation (5.2) as the 
summation of all the sensed pulse^br all the frames divided by the size of the speech signal; 
where the number of sensed pulse^lL found using equation (5.1) by multiplying the frames 
length logarithm by the number of nonzef^mlses (sparsity) of the frame. So far the sparsity of a 



frame was determined by thresholding the Wrmalized power residuals signal to different levels 

£>• 

then counting the number of nonzero pulse? left after thresholding. But what is the best 
thresholding level? To answer this question twj^ different approaches to finding the best 
threshold, and thus sparsity, are tested. 

Referring to Figure 23; thresholding results in raying frames with a large number of 
nonzero pulses and other frames with just a few pulses. An^>since CS methods cannot recover 
signals with very few pulses unless the number of measuremen-t^is increased, one approach to 
finding the best, yet the highest, threshold would be to increase th^^eshold level until no frame 
has less than 10 pulses, since from Figure 20 at sparsity 7=10 the^p^^ability that CS fails to 
recover the data is very small (about 0.5%), this would result in a comp < r^^on factor that varies 
from 0.6 to 0.8 depending on the speech signal. For Male3 speaker, the cornpression factor was 
about 0.597 with an SNR of 6.66. O 

a 

Another approach would be to fix the number of pulses in each frame; thafSrto zero out 
all but the highest T pulses in each frame. And since it was shown by Makhoul and Berouti [22] 
that about 88% of the residuals are of very small values, one can keep only the highest 12% 
pulses of each frame and zero out everything else. For our case each frame is 30 ms long, thus 
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the highest 12% pulses are the highest 29 pulses. This results in a compression factor of exactly 
0.66, where the SNR increases up to 3 dB higher than the previous approach. 
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Figure 30. Recovered residuals and speech signals along with a frame-by-frame speech SNR for Male3 

speaker with fixed sparsity and conditioned thresholding. 
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Figure 30 compares the two approaches described above for Male3 speaker. The plots 
show the improvement in the SNR for the voiced frames for the case when the sparsity is fixed 
for all the frames. HoweveK>the improvement is not consistent where there are some voiced 
frames that have higher SNR fo^the thresholding case. Also it is fair to note that the compression 
factor for the fixed sparsity case i^Jiigher and thus it is expected to have higher SNR. The plots 
also compare a zoomed in segment of^Lsth the residual and the speech for the two approaches. 

The plots in Figure 30 show that^e reconstruction is fair for both cases, the SNR and 
quality of the synthesized speech is also h^Jhj and it is difficult to favor one approach on the 
other. However, the conditioned thresholding ^proach results in compression factors that vary 
according to the speech signal, which is not preferali^ 

\ 



o 



% 
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6.0 SPECTRALLY SHAPING THE CS RECOVERY NOISE 



In this chapter, we introduce fn^spectral shaping of the noise that results from the compressive 
sampling process. Since we apply* Cjjj> on the speech residuals then synthesize the speech from the 
recovered residuals, the error that remits (between the original speech and the synthetic one) is 
similar to the error that results from '"synthesizing the speech from quantized residuals. The 
literature [22], [23] reports that the quantiza^bn noise can be spectrally shaped and this results in 
higher SNR and better synthetic speech quality^The spectral shaping method reported in [22] is 

<> 

adapted for the CS noise in order to enhance the quality of the synthesized speech. 

6 
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Figure 31. SNR curves for Male2 recovered by CS applied on the residuals and the speech signals 



Figure 31 above shows the SNR curves for a speech signal, Male 2, recovered using CS 
by minimizing the l-\ norm when applied on residuals obtained by CLP and RBLP. Also plotted 
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in Figure 31 is the SNR curve for the same signal recovered using the orthogonal matching 
pursuit algorithm (solid line) as presented by Sreenivas and Kleijnin [24]. The work presented in 
[24] applies CS directly onfjjjthe speech signal, not to the residuals like we did in the previous 
chapter, where the minimizatiojgproblem is stated as, 

[e, H] = min||3^ J H e|| 2 subject to ||e|| 0 = T 

9^^>and s = H e 

The method still uses the residuals as (p)e sparse excitation domain but uses an additional 
synthesis filter denoted by H, therefore the s«n$ed signal is a speech signal rather than a residual. 
A codebook of size L is constructed of matrrCpB from the training speech data, where H G 

{Hi,H 2 H L }, and y = <t> s. <A 

In order to regenerate the results in [24] we 3pply CS on raw speech data (with no 
thresholding) with H selected to be a Toeplitz matrix for ^ linear convolution of the impulse 
response of 1/A(z), instead of construction a codebook. Tr^n the CS problem is solved using 

'•6 

the OMP approach explained in Section 4.2.2. The OMP algorithm basically searches for the 
residual e that minimizes the squared error in the reconstructed spe^^under the constraint that 
e has a sparsity of T. The plot shows a great improvement in the^^R over our approach 
especially for higher compression factor; however, the resultant speech qua©y^was worse. 

The increase in the SNR with the degradation of the speech quality is due to the effect of 

o 

shaping the noise, as will be explained in Section 6.1. We investigate the effects dQioise shaping 
on the performance of the CS recovered speech signal. 

This chapter is divided into two sections. In Section 6.1 we briefly introduce the spectral 
shaping concept; it is not an attempt to thoroughly explain the theory, the reader is referred to 
[22], [23] for detailed discussions and derivations. In Section 6.2 we include a noise shaping 
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stage into our CS process. Various shaping filters are used and the recovered signal is 
investigated and compared to the original one. 

\ 

6.1 ADAPTIVE PI^DICTIVE CODING AND NOISE SHAPING 

Figure 32 below shows two quantization systems; (top) a traditional unit variance 
quantization system and (bottom) an adaptrtfo predictive coding system used to whiten the noise 
that results from synthesizing the speech fromquantized residuals. From here on; noise refers to 
the overall system noise (the error between the of^nal speech and the recovered speech) and is 



different than the quantization noise (the error between, the input and output of the quantizer). 
The quantization noise, u(n) in Figure 32, is defined as^n) = e(n) — e(n). 



s(n) 



A(z) 




Quantizer 







l/A(z) 



*<5 



u(n) 



s(n) 



e(n) 



Quantizer 



e(n) 



o 



s 2 (n) 



o 



A(z) - 1 



u(n) 



o, 



Figure 32. 



System 1, a block diagram of a traditional quantization system (top) and systems a 
quantization system with adaptive prediction (bottom) [22] 



Working in the frequency domain, the output of the system on the top graph is, 



5 t (z) = 5(z) + 



Noisei 



UQO 



(6.2) 
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In the time domain, the noise is defined as, 

Noise tl = u(n) * h(n) (6.3) 
where h(n) is the impulst^psponse of the inverse filter, 1/A(z), and * is a convolution 
operation. 

Thus the power of the noise is, \§\ 



°Nois ei = °$k => SNR 1= ^ (6.4) 



S 11 h 

Equation (6.2) indicates that the noise has(^e shape of 1/A(z), since the quantization error is 
spectrally flat. Whereas for the bottom graph themoise spectrum is flat and the output is given by 

\ 

5 2 (z) = SO) + I/(z) =^J^Toise 2 = U(z) ( 6 - 5 ) 
And thus the noise power is V* ^ 

ONoise 2 =ri => SNR 2^| (6-6) 

Comparing (6.4) and (6.6), SNR 2 is greater than SNRi, since^a^ > 1 by definition. Hence 
whitening the noise increases the SNR. However, the speech is s^id to suffer from background 

o 

noise in higher frequencies, causing the speech quality to degrade. vjpivas reported in [22] that 
further shaping of the noise using a filter B(z) as in Figure 33 increajS@the speech quality if 
B(z) is carefully picked such that the noise spectrum falls below the speech^spectrum envelope 
and is almost parallel to it at all frequencies. The output of the system in Figure ^3yis given by, 

S 3 (z) = S(z) + U(z)B{z) Noise 3 = U{z)B{z) v? ( 6 -7) 

where Noise 3 has the shape of 5(z) since t/(z) spectrum is flat. 
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Figure 33. 



System 3, a block diagra < j»3)f an adaptive predictive coding system with noise shaping [22] 



steli 



Therefore, if B(z) = l/i4(z) then syste^3 reduces to system 1; and if B(z) = 1, system 3 
reduces to system 2. In other words, the no^a^ shape of system 3 follows the shape of 5(z). In 
the next section, we modify the CS process ^^hicorporate spectral shaping of the CS noise; 
several choices of B(z) are tested and the resultanf^e^ech is investigated. 

\ 

6.2 SPECTRALLY SHAPING THE COMPRESSIVE SAMPLING ERROR 

As shown in Section 6.1, the shape of the noise spectrum follows B(z) spectrum; if B(z) is 

o 

chosen to be 1/A(z), then no shaping is applied and the output nois^pectrum has the shape of 
the speech spectrum. CS however is a different process than quanti^ujpn, though there is a 

CL 

similarity in the sense that in both processes the speech is synthesized firom a different but 
similar version of the residuals. Investigation the CS noise (the error between th^priginal speech 
and the CS recovered speech), it was found that the noise almost has the same shap^of the input 
speech; this means that one can increase the SNR and the speech quality by spectrally shaping 
that noise so that its spectrum fall below the spectrum of the original signal at all frequencies. 
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Figure 34. Original speech and CS (on CLP residual^ noise spectrums for Male 2 

Figure 34 above shows, (a) the spectrum of a segment of the input speech signal along 
with the spectrum of the LP inverse filter 1/A(z) and (b) the(^pectrum of the CS noise. It can be 
seen from the plots in (b) that the CS noise almost has the same^^^pe of the input speech signal. 
Listening to the noise, it sounds like a whispered version of the speech, which degrades the SNR 
and results in a recovered signal that suffers from background noise. ^ 

Figure 35 below shows the spectrum of the noise that results IrblL. applying CS to the 

o 

speech directly using OMP. The plots, in contrast to the ones in Figure 34 (b), show that the 



noise is almost white or at least does not have the same shape as the speech signak^ 
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Figure 35. Original speech and CS (on speech using ©J&P) noise spectrums for Male 2 

\ 

A question that begs an answer is how to embed ^noise shaping step in the CS process? 

C 

The answer to this question is not obvious, however, the incase in the SNR that results when 
performing CS on the speech rather than on the residuals implii^that the noise was shaped as a 
result of shaping the sensing matrix. Q 

Let's look at our original CS process, where the sparse represent^on is the residual basis, 
e = min||e|| 1 subject to y = O e 

(6.8) 

and s = H e , 

o 

Like the quantization error u(n) in Section 6.1, the error in e is spectrally £t^t. Therefore, 
synthesizing the speech using H results in an error, s — s, that has the spectral sha^pe of H 
the other hand the CS process introduced in [24] is summarized in equation (6.1) as: 
[e,H| = min||y-<I>He|| 2 subject to ||e|| 0 = T 

e.h 



On 



where, s — He and y = 4>s = 4>He 
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But since the noise that results from the process described by equation (6.1) is almost flat, as 
shown in Figure 35, we argue that one can spectrally shape the noise that results from our 
original CS process, equatioj£j(6.8), by shaping the sensing matrix <I>. The sensing matrix can be 
shaped by multiplying it with ^shaping matrix A of the impulse response of the shaping filter 
7l(z). As a result of using A, the ej^or in e is no longer flat but rather has the shape of 1/A; and 
hence the error in s has the spectral sn^e of H/A. 

Thus the BP minimization probler^fter incorporating a shaping step becomes: 
e = minllell! subtectto y= 4>Ae 

y- (6.9) 

and H e 

If A is selected to be 1, no shaping is applied, wMoh results in the CS process as applied in 

\>* 

Chapter 5; where the noise has the shape of 1/A(z). (\ 



Performing CS on the speech signal directly (e^qXiivalently, performing CS on the 
residuals while shaping the sensing matrix with A = H) to recreate the results presented in [24], 



using OMP methods for reconstruction, results in an SNR of 9.o"dp>and a noise spectrum that is 
almost flat as shown in Figure 35. But as mentioned above, the syiit^ejic speech sounded worse 
than the case with no shaping (when BP was used for recovery) even th^gh the SNR is almost 3 
dB higher. C> 

Nevertheless, it is understood that BP methods are stronger, though more complicated, 

o 

than OMP methods; as argued earlier in Section 4.4 and as shown in Figure 18Qberefore, we 
test shaping the noise that results when applying CS (using BP for recovery) on the CLP 
residuals with a shaping matrix A = H. Figure 36 below shows the resulting noise spectrum. 
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Figure 36. 



CS noise spectrum shaped with a filter A(z) =^1/A(z) 



Choosing A (z) = l/i4(z) results in a CS noise trMp^ almost white, as shown in Figure 



36. It also causes the SNR to increase to 12.7 dB (almost 6 Q-B increase compared to the case of 



CS with no shaping). Furthermore, the synthesized speech had-a^ery good quality where the 



roughness that existed before shaping is reduced and with less background noise. 

Next, we use a version of the inverse filter whose spectrum hal&oader peaks as a noise 
shaping filter to investigate whether the speech quality can be further impr<@bd or if the SNR can 
be increased. Choosing A(z) = l/Efc=o a /e 0-9 k z k where a 0 = 1 results in»the SNR to go to 

o 

10.5 dB and the speech to sound almost the same as the case when A(z) = l/(A^z) but with 
added background noise. Figure 37 shows the resulting noise spectrum compared to the original 



speech spectrum (a) and the frequency response of both the inverse and shaping filters (b). 
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Figure 37 



CS noise spectrum shaped with a filter A{^^= l/Y,k=o a k 0- 9 z 

Figure 37 shows that the noise spectrum is more ^olored in the formant regions and that 
justifies the lower SNR; further, the noise spectrum is not w^jl^below the speech spectrum for all 
frequencies, which justifies the lower speech quality. 



*<5 



Referencing Makhoul and Berouti [22], using a shaping fnCer^5(z) that is a second order 
all-zero fit to the signal spectrum, with the coefficients as in equatioj}^6.10) below, results in a 
better quality speech since the filter's frequency response lies below thtQpeech spectrum at all 
frequencies. Thus for the noise to have the shape of 5(z), a shaping filter A (jz> = l/B(z)A(z) is 



used where the coefficients of S(z) are defined as [22]: 

Pl(p2 ~ Po) 



Po 2 - Pi 2 



b(2) = 



Pi ~ P0P2 

Po 2 - Pi 2 



% 

V (6.10) 



where 6(0) = 1, and is the i th autocorrelation coefficient of A(z) defined as 



p-i 



~>i = ^ a(k)a 



(fc+1) 



/c=0 



(6.11) 
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Figure 38 below shows the results of using the shaping filter A(z) = l/B(z)A(z). Figure 
38 (b) shows that the spectrum of B(z) = H(z)/ A(z) does not fall well below the spectrum of 
\/A{z)\ and as a result, thd^ectrum of the noise is not well below the speech spectrum. Thus 
the synthetic speech still suffer^kom hissing noise even though the roughness that existed before 
shaping is reduced; the resulting sp^bch has an SNR of 10.35 dB. 
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Figure 38. CS noise spectrum shaped with a filter A{z) = 1/B(z)y4(z) 

On the other hand, using the filter A(z) = B(z)/A(z) results in meAjoise spectrum to fall 
well below the speech spectrum at low frequencies and slightly above it <at^ high frequencies. 
Listening tests show that the speech quality considerably increases where the h@ing, roughness 
and background noise are significantly reduced and the SNR goes to almost 14 dB.vp 

Figure 39 shows the results of shaping with A(z) = B(z)/A(z); the plots indicate that the 
low frequency noise is reduced which results in increasing both the SNR and the speech quality. 
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Figure 39. 



CS noise spectrum shaped with a filter A(z^= B(z)/j4(z) 
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Table 1 below summarizes the results of embedding^a^ioise shaping step into the CS process. 
Table 1. Noise shaping effect on the CS/CLP recovered speech for^ VIale2 at compression factor of 0.4 



Filter transfer function 


Speech SNR 


*Ef]|£ct on speech quality 


No shaping A (z) = 1 


6.9 dB 


Speech suffer^irom roughness and sounds 
synthetic. Q 


Sreenivas and Kleijnin [24], 
A(z) = 1/A(z) withOMP 


9.6 dB 


Speech suffers fi^Ji roughness, hissing and 
high background n^i^. 


A{z) = 1/A(z) 


12.7 dB 


Good speech qualrty^nd the roughness is 
noticeably reduced. (~) 


1 


10.5 dB 


Good speech quality; a^tftthe roughness is 
noticeably reduced. , 




10.35 dB 


Good speech quality; the(~Voughness is 
reduced but with high backgroi@l noise. 


flfz) 


13.9 dB 


Very good speech quality; and thoroughness 
is drastically reduced. 
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Figure 40. 



SNR curves for Male2 for speech recovered usjAg CS on CLP residuals with and without 



noise shaping 



Figure 40 shows the SNR plots for the speech recovered with no shaping by CS on CLP 
and RBLP residuals, speech recovered by applying CS directlyjj^n the speech using OMP, and 
speech recovered by CS applied to CLP residuals while shaping tr{e)ioise with various shaping 
filters. ^ 

The results in Table 1 and Figure 40 are for the case where the residuals are obtained 
from CLP. However, as Chapter 5 recommends, speech recovered by applying CS to the 
residuals obtained from RBLP has a better quality. Therefore, the spectral shap^ef CS noise is 
studied for RBLP residuals; where not only the residuals are of the RBLP but als^the inverse 
filter coefficients that are used to shape the noise are the RBLP filter coefficients. 
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Figure 41. 



Compression ^ictor 

SNR curves for Male2 for speech recovered^jjjg CS on RBLP residuals with and without 
noise shaping \ > 

Table 2. Noise shaping effect on the CS/RBLP recovered speech for ft^Jj^2 at compression factor of 0.4 



Filter transfer function 



Speech SNR 



Effect en speech quality 



No shaping A (z) = 1 



6.6 dB 



Speech is of a gcfed^auality but suffers from 
roughness and sounds synthetic. 



Speech suffers frorrl Wjighness, hissing and 
high background noised 



Sreenivas and Kleijnin [24], 
A(z) = 1/4 (z) with OMP 



9.6 dB 



ar£u 



A{z) = l/A{z) 



14 dB 



Good speech quality; and the roughness is 
noticeably reduced. 



Good speech quality; and thoroughness is 
noticeably reduced. 



A(z) = 



Y, p k=o a k 0.9«z 



' a ° = 1 



11.9 dB 



butf'w 



A{z) = 



B{z)A{z) 



10.83 dB 



The roughness is reduced but<^with high 
background noise. 



A{z) = 



Bjz) 
A(z) 



15.1 dB 



Very good speech quality; and the roughness 
is drastically reduced. 
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Table 2 and Figure 4 1 summarize the implementation results and show similar results to 
those of Table 1 and Figure 40 but for the RBLP case; they confirm that spectral shaping of the 
noise increases both the S^R and the synthesized speech quality. They further confirm that 

^> 

applying CS to BRLP residuals^asults in better results than when CS is applied to CLP residuals 
even in the case where the noise is-^ectrally shaped. 

X 

\ 

o 

o 

% 
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7.0 SUMMARY OF RESULTS 



Speech was successfully compreSsi^ely sampled as stated in Chapter 5 and Chapter 6. 



It was shown in Chapter 5 that speech synthesized from recovering compressed sensed 
residuals obtained by RBLP had a bettef\quality than speech synthesized from CLP CS recovered 

CO 

residuals; which makes sense since the rorJ^t linear prediction filter provides a better fit to the 
speech spectrum. Even though for some speakers, e.g. Male 2, the SNR is higher for the CLP 

•0 

case; the quality of the speech sounded better for th&RBLP case. It was also shown that setting a 
fixed sparsity level for all the residuals frames yields^ fixed compression factor that is know at 

o 

the beginning of the process; which is better than setting a-threshold level where the compression 
factor cannot be determined until the threshold step is done^lso, setting a fixed sparsity level 
guarantees that no frame is left with a low number of pulses. fLj^s shown in Chapter 4, Figure 
20, that signals with very few pulses are more likely not to beNsiwcessfully recovered unless 
more measurements are taken. For the case of a signal with lengtlv^O, it was shown that for 
example signals with only 4 pulses are likely not to be recovered tfJtjjfost 54% of the time 
compared to signals with 12 pulses, for example, that are likely to be successfully recovered 
almost 90% of the time. Q 

The results from Chapter 6 show that the speech quality and the SNIVjaan be well 
improved by spectrally shaping the CS noise. For all the tested shaping filters, no more 
parameters are needed to be transmitted since the shaping filters coefficients can be calculated at 
the receiver end using the LPC's. Implementation results were compared to the results of a 
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previous work on compressive sampling of speech [24] where the CS process is performed 
directly on the speech signals and OMP algorithm are used for recovery. 

As seen in Figure ^Q, the SNR curves for the case when compressive sampling is 

\ 

performed by BP methods are^puch higher than when the case where OMP methods are used. 
This is expected since, as shown jn^Section 4.2 and Figure 18, BP algorithms are stronger than 
OMP algorithms. However, BP algd^hms are far more complex. It was reported [21] that the 
OMP algorithm described in Section 4.2*lLs a complexity of 0(TmN) compared to 0(m 2 N 3 / 2 ) 



for some BP approaches, which indicates ytkat the complexity grows quadratically with the 
number of measurements. A simple indication^^the complexity of the BP in comparison with 
OMP is the execution time. For example, recoveinig>a speech signal of 2.64 sec, Male 2, at a 
compression factor of 0.4 using OMP is executed in v a1inost 0.6 sec, while performing the same 
operation using BP is executed in about 19 sec. Howeve^^^e can always compromise between 
the quality of the recovered speech and the complexity of the(p^ocess. 

o 

o 

% 
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CONCLUSION 



Compressive sampling offers '^acquisition scheme that is very simple at the transmission end, 
where the signal is sampled ^^j^ a random sensing matrix that acquires a number of 
measurements less than the dimension* of the signal. On the other hand, at the receiver end, the 
process is quite complex and is expensivfAn terms of computation when BP algorithms are used. 

CO 

We apply CS on speech residuaK^)and conclude that it is more efficient to apply 
compressive sampling on residuals obtained fip^rh robust linear prediction algorithms than the 

\> 

conventional linear prediction residuals. fft. 

We show that the noise that results from CS can>be spectrally shaped using shaping filters 

c 

with coefficients that can be calculated from the linear^prediction filter's coefficients. It was 
shown that spectrally shaping the noise improved the SNR^minimized the effect the CS noise 
and resulted in high quality speech with high SNR up to 15 dB*at# compression factor of 0.4. 

o 

o 

% 
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FUTURE WORK 



% 

Applying compressive^ampling to speech residuals obtained from robust linear 
prediction analysis then spectralfy^haping the resultant noise using a pole/zero filter results in 
satisfying results for a compression^ctor of 0.4 and above. A compression factor of 0.4 was 
achieved when keeping the largest 18 v 5ulses in the residuals signal then taking 18 C log(iV) 

CO 

measurements where C was set to 1. Howler, smaller C's that generate smaller compression 
factor haven't been studied. The plots in Figure* (20) point out that for the same signal length, 
smaller C's can be used if the sparsity is higher. HJhce, one can compromise the sparsity of the 
residuals by the number of measurements taken (higher C) which may generate interesting 

o 

results. (\ 

c 

The sensed signal will be quantized then sent over tht^transmission channel where more 
noise is added. If the compressed sensed signals are very sensiti^e^to channel or/and quantization 
noise, CS cannot be used as a practical acquisition scheme. Therelo^ it is important to study the 
effects of quantization on the sensed signals. Although this is beyonS^ie goal of this research, 
we studied the sensed signals and found that they are normally distributelC-^hh almost zero mean 
and unit variance. However, the effects of quantization and channel noise stillTneed to be studied. 

o 

% 
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APPENDIX A 



SPEAKERS AND SENTENCES INFORMATION 

\ 

Noisy/Male 1: "Alice in wonderland"; recorded using a commercial microphone. 
Clean/Female: "I ate every oyster (^kfora's plate"; from the TIMIT database. 
Clean/Male2: "Don't ask me to carry a^oily rag like that"; from the TIMIT database. 

V 

Clean/Male3: "He will allow a rare lie"; fQtfn the TIMIT database. 

\ 

\ 

o 

o 

% 
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APPENDIX B 



EXTENDED RESULTS FOR DIFFERENT SPEAKERS 



45 



40- 



35 



30- 



m 25 

to, 

a. 

m 20 




BP on CLP Residuals . r\ 

■BP on RBLP Residuals > 
■OMP on Speech 
■BP with NS: a(z)=1/A(z) 
■BP with NS: A(z)=1/((1+b 1 z" 1 +b 2 z _2 ^A^)) 

■ BP with NS: A(z)=1fe(0.9 k a k z" k ) 

BP with NS: A(z)=(1 +b 1 z 1 +b 2 z" 2 )/A(z) (\) 



15 - 



10 



Figure 42. 



SNR curves for Malel/Noisy for speech recovered using RBLP residuals with and 

without noise shaping q 

o 

% 



84 



45 r 

40- 
35 - 
30- 
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a. 

m 20- 

15 - 
10- 



■ BP on CLP Residuals 
-BP on RBLP Residuals 
■OMP on Speech 
-BP with NS:a(z)=1/Ai 
-BP with NS:a(z)=1/(( 




z 1 +b 2 z- 2 )*A(z)) 



■BP with NS: A(z)=1/z(0.^|x ; z" K ) 
BP with NS: A(z)=(1+b z^b 2 z" 2 )/A(z) 




Compression ^lictor 

Figure 43. SNR curves for a Female Speaker for speech^ recovered using CS on RBLP residuals with 

and without noise shaping \ ■ 
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Figure 44. SNR curves for Male3 for speech recovered using CS on RBLP residuals with and without 

noise shaping 
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